About new dynamical interpretations of entropic 
model of correspondence matrix calculation and 
Nash-Wardrop's equilibrium in Beckmann's 
traffic flow distribution model 

I Gasnikova E. V. Nagapetyan T.A. 

O 

<N December 26, 2011 

O 

(D 

^ 1 Correspondence Matrix Calculation ModeQ 

Assume that in some town there are n districts (regions), > is the 
I— I number of residents Uving at the district i, and Wj > is the number of residents 

working at the district j. By (t) > we will denote number of residents living 
at the district i and working at the district j at the moment of time t > 0. Over 
(-H course of the time numbered residents (whose quantity doesn't alter, and is equal 

n n 

^ to N = J2 = J2 ^j) change their apartments (homes). And we suppsose, 

1=1 j=i 

that changes may happen only by the means of the exchange of the apartments, 



S 



n n 

> x^j{t)>0, Y,x,,{t)=L„ ^x,j(t) = Wj, i,j = l,...,n. (1) 



00 



Suppose, that at the time t > resident r lives in the district k and works 
in the district m, and the resident / lives in the district p and works in the 
district q. Then Pk^-pq (t) + o{At) - is the probability for the residents 
^ I with numbers r and 1 (l < r < I < N) to exchange their apartments in a 

I period of time {t,t + At). It's natural to consider that probability (in the unit 

• • time) of exchanging apartments depends only on the location of the workplaces 

. ^ and homes, which are exchanged. For instance, it may be considered that the 

"distance" between district i and district j is Cij > 0, and 

5-j L L 

Pk,7n- p,q (0 =P exp ( {Ckm + Cpq) - {Cp,n + Ckq) ) > 0. 

V- ' " V- ' 

sum of the distances sum of the distances 
before exchange after exchange 

Then, by the virtue of the ergodic theorem for discrete homogeneous Markov 
process with finite number of states, for all {a^ij}"!"^^]^ we have that 

lim P{xij (t) Xi.j,i,j = 1, . . . ,n) = 



^This section was written, based on the works [l] ~ 
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where Z is the normahzing multipHer. 

Here we have the case where the final distribution, which is also a stationary 
distribution, satisfies detailed balance conditionj^ 



where 

p=p{{xii,...,Xkn 



l) • P • Pj^ fji; p,q 



■ ; ^p 



— 1, j — 1 j Pptin; k,q'> 



Distribution P j^^j on a set ( 1 ) is concentrated with 1 (see 

below) in a neighborhood of the most probable value {^ij}^!-" j^^j which is 
determined as a solution of the following entropic -linear programming problem: 



n, n 

E ■ 



'ij In x-ij 



n, n 
= 1, 3 = 1 



mm 



(2) 



Solution of this problem might be presented as 



exp (-1 - 



A 



2cij) , 



where Lagrange multipliers (dual variables) |A,f }"_^ and {'^]^}"_^ are deter- 

minecQ from the system of equations ([T| . In practice we usually have some 
information about {Li, Wi}^^^ and {cy },.l"„._i . So, when we solve (121), we find 



i=i,j=i- 



If TV ^ nm, \ Vz, j = 1, . . . , n — ?> Li, Wj 



c > 0, then the dis- 



tribution of the probabilities p ^{a^ij}"^" i=i) ( 1 1 is concentrated in 

O (y/m) neighborhood of the most probable value x*j « LiWj/N ^ m/n, i,j = 
1, . . . ,n. More precisely: 

WMj - l| < >^/Vm) > 0.999 



3A > 0: lim PNi,j = 1, . 



Indeed, let us note, that 



dx. 



< 



^ Multipliers before probabilities, for example, in the state {xij}'^_!_" j— ii arise because of 
the number of the ways to choose the resident, living in the district p and working in the 
district m, is Xpm, and independently the number of ways to choose the resident, living in the 
district k and working in the district q, is Xf-g. 

^ This can be done in a different ways. For example, by Bregman's balancing method or by 
Newton's method |5j. The other way is to solve the dual problem for the entropy programming 
problem |[2|. There are a lot of different algorithms with the first order oracle (MART, GISM, 
etc. |4], \5\). It can be shown that most of this methods (including Bregman's) are just 
barrier-multiplicative antigradient descending methods 11 . At the end (when the iteration 
process is achieving a sufficient small vicinity of the global minimum) it is worth to use the 
second order interior-point method, like Nesterov-Nemirovskii polynomial algorithm |12| (for 
so-called "separable" tasks). 
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Thus,V {x,j}tl^^,eM 3 9e[0,l] 



In 



P {{^^J}tl j=i) < ({4 It" ,=1) + 



1=1, j = l "^^y 



Since 



92 lnp({x,j}"^"^^.^,) 



n, n 



we have "inequality of measure concentration" : 

n, n I * ^2 

VM>0, V E , r ""^ . ^ > 

2 Beckmann traffic flow distribution mode0 

Let us consider the oriented graph T = (V, E) , which stands for transporta- 
tion route in some town {V - nodes (vertices), E <Z V x V - arc of the net- 
work (edges)). Let W = {w = : i,j & V} be a set of pairs inlet-outlet; 
p = {^1,1^2, ■ • ■ ,Vm} - route from vi to Vm, if {vk,Vk+i) € E, k = 1, . . . ,m - I 
(it will be shown later (see example by V.L Shvetsov) that, to specify the path it 
may not be enough to indicate only the set of vertices. In general, one must also 
specify exactly which edge, connecting the specified vertices, is chosen); P^, - 
set of routes in correspondence w £ W; P — Utoew ~ collection of all routes 
in the network T; Xp - flux on the way p, x — {xp : p G P}; Gp (a?) - specific 
costs of travel on the road p, G (x) = {Gp (x) : p £ P}; ye - flux on the arc e: 
y = Qx, where 6 = {^ep}eeE,peP i^ep = {1, e G p; 0, e ^ p}); (j/e) - specific 
costs of travel on the arc e (generally increasing, convex, smooth functions), it 
is natural to assume, that G (x) = Q'^f{y). Let flows on correspondences d^,, 
w e to be known. Then x, which describes flow distribution, must lie in the 
set: 

X — <.x>Q: ^ Xp — dyj, w £W 

Consider a game in which each element w G W corresponds to a considerably 
big {dw S> 1) set of players of the same type. The set of pure strategies of 
such player is P^,, and profit (minus losses) is defined by the formula —Gp (x) 
(a player chooses a strategy p € P^ and neglects the fact, that |P„| components 
of the vector x and hence the profit depends slightly on his choice). One can 



'This section was written, based on the works I13| 
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show, that Nash equihbrium is equivalent to complementarity problem, which 
equivalent to a solution of variation inequality, which, in its turn equivalent to 
a solution of convex optimization problem. 



= 



t 

\1x<eX^ (g{x*),x~x*'^ > 



* (f ) = ^ / '^e (z) dz -> min . (3) 

eeE I 

It is easy to show, that in the case G (a?) being strictly monotonic transformation, 
the Nash-Vardrop equilibrium a'* is unique. If Tg (?/e) are increasing functions 
then y* = Qx* is unique, although, as we will see later, x* isn't necessarily 
unique. 

The route at a step (n + 1) player at correspondence w, choose independently 
according the mixed strategy with probability 

Prob;^ (n + 1) = 7„ • max [x^ {n) , n"!} exp (-Gp (f (n))/r)/Z,7, w 

to choose path p e (0 < 7„ < 1), and with probability 1 — 7„ to choose 
the same strategy as at the n-th step. Here Xp {n) - number of players at w, 
who have chosen at the n-th step strategy p S Pwi and Z"^ can be found from 
the normalization condition. Multiplier max {xp (n) , n~^} describes the will to 
imitate and, also, the reliability of using this strategy. This multiplier notices 
specifics of the problem (without it there could be convergence to something 
different from the Nash-Wardrop equilibrium). Parameter 7 describes "the con- 
servatism" , while "the temperature" T stands for "the risk appetite" . 

Theorem 1 Let T > be sufficiently small, ^ 7„ = 00, ^ (7,1) < 00. Then 

n—1 n—1 

^(x(rt)) "^Ix*), where x* is the minimizer from (Isl). Moreover, if the 

equilibrium is unique, then x (n) x* . 



In the experiments, conducted at the Laboratory of Experimental Economics 
in the Faculty of Applied Mathematics and Control, MIPT, in which students 
of the 5*'' course were involved, we observed the convergence to equilibrium and 
"vibrations" around it. Fluctuations should be explained, apparently, by the 
fact that in experiments the number of players was small and the hypothesis of 
a competitive market was not performed. We also observed, that for students 
7„ = 7 > it is more likely, than 7„ ^ 1/n. As a result there will be convergence 
not to the equilibrium point, but to its neighborhood. Size of the neighborhood 
depends on T, 7 > and the number of players. 

Example 1 (Braess paradox, 1968 [15]) Let correspondence xn = 6 
thousand cars/hour (see graphs on Figures [l]and[2]). Weight of the ed ges is time 
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Figure 1: Case 1. a:i24 — 3:134 



— 3. Total time for each path is T — S3 min. 




Figure 2: Case 2. 2:124 — 2:1234 — 2:134 — 2. Total time for each path is T — 92 min. 

delay (in minutes) when the flow on the edge is yij (thousand cars/hour). For 
example, in case 2 (see Figure [2]): 7/24 = 2:1324 + a;i24- It is natural that time 
delay (at each of the edge) is a growth function of flow. 

The following example shows, that under the very natural conditions vector- 
function of cost of the travel G (x) can't be strictly monotone: 

3x,yeX (x^v):G{x)^G{y)^ iG{x)- G (y) , f-y)=0. 

This, for example, can be because of 

G(f) = e^f(y), y^Ox, 

where y = {ye}eeE describes the loading of edges (arcs) of a graph of the 
transport network, f{y) — {t^ (?/e)}eg_E ~ vector-function of cost of the travel 
on the edges of transport network, Q ~ incidence matrix of edges and paths, 
and different vectors of flow distributions x may correspond to the same vector 
y = Qx. 

Example 2 (Nonuniqueness of the equilibrium; Shvetsov, 2010). 

On Figure [3] the equilibrium flow distribution is shown, for all x G [0, 0.5]. 



0.5 D.5 




Figure 3: Nonuniqueness of the equilibrium. 
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Theorem 2 Let T > be sufficiently small, ^ 7„ = oo, ^ (7„) < oo. Then 

n—l n—1 

^' (£"(«)) 'i' {x*) and X {n) -^^^ x* {x {0)) . Note most of the elements of 



n— ^oo n— >-C30 



X* {x (0)) can be equal to zero. 

We should notice, that Theorem [2] is a refutation (in case of the considered 
dynamics) of the hypothesis pLS] • It states that in the case of non-unique Nash- 
Wardrop equihbrium, the equiHbrium is more hkely to reahze, and it is a solution 
of the following linear-enthropy programming problem 

V V {xp\n{xp/\P^\) - Xp) ^ ^ min 
weWpGP^ 

where y* - is the unique solution of V (y) = / ''e {z) dz — miuj^^Qj sex- 

eeE 

3 Sketch of the proof of the Theorem [l] 

Lemma 1 Let f (w) = — Tlnw, where w G (0, 1). > — are some ran- 
domly chosen, but fixed parameters; Wi G (0, 1). Let us consider functions 

Fq {w) — ' , and Fi (w) 



i i 

Then Fq (w) < Fi {w), and the equality is attained only when 

Wi — W2 = ■ ■ ■ = w* . 

Proof. 

The proof is based on the consequent usage of the inequality between harmonic 
mean and geometric mean and then Cauchy inequality. ■ 

Lemma 2 For any x (n) (z X : x (n) ^ x* holds the following inequality 

{grad^f {x{n)) , E [x(n + 1) — x {n)\ x (n)]) = 

= (^G{x{n)),E[x{n+l)-x{n)\x{n)]j < 0. (4) 

Proof. 

Without restricting the generality, we can assume that V p G P — > (n) > 1. 
Then 

(^G{x{n)), E[x{n+l) - x{n)\x{n)]] 
E xp in) Gp (f(n))exp(- ^'^^!,^"^M ^ Gp{x{n))xp{n) 

P^P^ \ J P<^Pu, 



In ^ du 



/ Gp{x{n)) \ E ^p{n) 

Xp (n) exp I I peP„ 
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From Lemma [T] it follows that 

(^G {x (n)) , E [x {n + 1) -x{n)\x{n)]j < 0. 

And the equality can be attained only on the equilibrium vector x* , which can 
not be under considered hypothesis. ■ 

Remark 1 Lemma^can be more specified. At some neighborhood of the equi- 
librium there exists I > 0, such that 

(^G{x{n)), E[x{n+l) -x{n)\x{n)]j < -Ijn ■ {1' {x (n)) - ^ {x* )) . 

Also, with some reserves, we can change constraint x (n) Cz X to x (n) > 0. 
Lemma 3 ([25j, Chapter 2.2) Let 

oo oo 

In = oo, ^ (7„)^ < oo. 

n=l n—1 

Then 

^ix{n)) ^ 

n— f oo 

and if the equilibrium is unique, then also 

-> / \ a.s. -.^ 

X (n) — !• X . 



Proof. 

Lemma [2] and Theorem 1 from chapter 2.2 of [25] allow us to consider only the 
situation, when x (n) is close to x* . Then by Taylor formula we have: 

S (.f (n + 1))| .f (n)] = * (x(n)) + 

+ (grad^'(f (n)), E [x {n + 1) - x {n)\ x {n)]) + O (^{jnf^ . 

If we take mathematical expectations from both sides of this equality, we 
will get that there exists sufficiently large C > 0, such that 

E{^{x{n + l)))~'f{x*)<{l- Z7„) • {E {x (n))) - * (f *)) + C • {j^f . 

From more general statement from [25j we get that 

Ei^ {x{n))) (x*) — > 0, 

n— J-cxD 

if 

00 00 
n—l n—1 

From Kolmogorov inequality follows 

F(Vn > no ^ ^'(x(n)) -^{x*) < e) > 

>1-s-'-(e (f (no)) - ^ {x*)) + £ hkf] ■ 

\ k=no / 

Which concludes the proof. ■ 
In the end we will formulate a known result, which is in high correlation with 
the proved one. 
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Theorem 3 Lef] T > 0. Then there 3C,a>0:VA^eN 

^ E ^ - ^ ;7^) ^ 2 exp i-C ■ n) , 

where 7 = 
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